View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0001311 | K18X001.00 SKB SWAN | SW | public | 2021-08-06 16:22 | 2021-08-20 11:48 |
| Reporter | Assigned To | (ALTech) Sangmin Choi | Due Date | ||
| Priority | high | Severity | s2-severe | Reproducibility | always |
| Status | closed | Resolution | fixed | ||
| Summary | 0001311: [GTS]testNonInstantApp/testInstantApp | ||||
| Description | SW Version: 19.531.10 GTS Version: 8.0_R4(8-10) Test command: 1.run gts -m GtsPlayStoreHostTestCases -t com.google.android.gts.playstore.UsageStatsHostTest#testNonInstantApp 2.run gts -m GtsPlayStoreHostTestCases -t com.google.android.gts.playstore.UsageStatsHostTest#testInstantApp Because Google do not open GTS source code, it's hard to analyze this failure, all we can do is to analyze the logcat I have checked these 2 failures by using daily build. 20210722 Daily build -> Pass 20210723 Daily build -> Fail so I review the diff file (0722_0723.diff) between these 2 daily builds According to the logcat. "Unexpected number of activity stops expected:<3> but was:<2>", so I think this failure is related to UI. I also saw the Home app is update in the following commit in diff file vendor/skb/prebuilts/digicap_btv-app changed from 503b05c05444ff0b19a868ddd4df465a13a94c0f to 64b80f062afe2eab939cc9aa58e673ac82ed00a5 [+] Thu Jul 22 18:05:59 2021 +0900 | kimyh@digicaps.com | 64b80f0 | SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18719_foxconn_20210722 배포 so I use the 20210722 Daily build and install the SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18719, then the result is fail. the root cause is in SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18719, but I don't have source code of Home app, so please forward this information to Digicap. They should review the change log between SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18636 and SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18719 | ||||
| Steps To Reproduce | 08-06 15:02:57.584 7702 7733 I TestRunner: failed: testNonInstantApp(com.google.android.gts.playstore.UsageStatsTest) 08-06 15:02:57.584 7702 7733 I TestRunner: ----- begin exception ----- 08-06 15:02:57.584 7702 7733 I TestRunner: 08-06 15:02:57.584 7702 7733 I TestRunner: junit.framework.AssertionFailedError: Unexpected number of activity stops expected:<3> but was:<2> 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.Assert.fail(Assert.java:50) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.Assert.failNotEquals(Assert.java:287) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.Assert.assertEquals(Assert.java:67) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.Assert.assertEquals(Assert.java:199) 08-06 15:02:57.584 7702 7733 I TestRunner: at com.google.android.gts.playstore.UsageStatsTest.testNonInstantApp(UsageStatsTest.java:94) 08-06 15:02:57.584 7702 7733 I TestRunner: at java.lang.reflect.Method.invoke(Native Method) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestCase.runTest(TestCase.java:168) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestCase.runBare(TestCase.java:134) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestResult$1.protect(TestResult.java:115) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestResult.runProtected(TestResult.java:133) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestResult.run(TestResult.java:118) 08-06 15:02:57.584 7702 7733 I TestRunner: at junit.framework.TestCase.run(TestCase.java:124) 08-06 15:02:57.584 7702 7733 I TestRunner: at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:195) 08-06 15:02:57.584 7702 7733 I TestRunner: at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:181) 08-06 15:02:57.584 7702 7733 I TestRunner: at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:564) 08-06 15:02:57.584 7702 7733 I TestRunner: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2196) 08-06 15:02:57.584 7702 7733 I TestRunner: ----- end exception ----- 08-06 15:03:13.785 8152 8184 I TestRunner: failed: testInstantApp(com.google.android.gts.playstore.UsageStatsTest) 08-06 15:03:13.785 8152 8184 I TestRunner: ----- begin exception ----- 08-06 15:03:13.786 8152 8184 I TestRunner: 08-06 15:03:13.786 8152 8184 I TestRunner: junit.framework.AssertionFailedError: Unexpected number of activity stops expected:<3> but was:<2> 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.Assert.fail(Assert.java:50) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.Assert.failNotEquals(Assert.java:287) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.Assert.assertEquals(Assert.java:67) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.Assert.assertEquals(Assert.java:199) 08-06 15:03:13.786 8152 8184 I TestRunner: at com.google.android.gts.playstore.UsageStatsTest.testInstantApp(UsageStatsTest.java:142) 08-06 15:03:13.786 8152 8184 I TestRunner: at java.lang.reflect.Method.invoke(Native Method) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestCase.runTest(TestCase.java:168) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestCase.runBare(TestCase.java:134) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestResult$1.protect(TestResult.java:115) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestResult.runProtected(TestResult.java:133) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestResult.run(TestResult.java:118) 08-06 15:03:13.786 8152 8184 I TestRunner: at junit.framework.TestCase.run(TestCase.java:124) 08-06 15:03:13.786 8152 8184 I TestRunner: at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:195) 08-06 15:03:13.786 8152 8184 I TestRunner: at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:181) 08-06 15:03:13.786 8152 8184 I TestRunner: at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:564) 08-06 15:03:13.786 8152 8184 I TestRunner: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2196) 08-06 15:03:13.786 8152 8184 I TestRunner: ----- end exception ----- | ||||
| Tags | No tags attached. | ||||
| Attach Tags | |||||
| related to | 0001313 | closed | (ALTech) Sangmin Choi | [CTS] 14 UI-related failures |
| User List |
(ALTech) Sangmin Choi , (ALTech) SY Yoon , (SW) Jacky Chiang |
|---|
|
2021-08-06 16:22 developer |
0722_0723.diff (2,915 bytes)
file1=D189.xml file2=D190.xml changed projects : vendor/foxconn changed from b5643642b967139f63f46a6765a2c720408e6e24 to b64c8983bb664d9966330d4e5a5f8b36813b0cd6 [+] Thu Jul 22 18:16:38 2021 +0800 | bcan.cc.yeh@fii-fo.. | b64c898 | [BFXBTF-242] Update prebuilt AttDaemon(210618,1) vendor/scripts changed from a18c271d0e8a6c1932e5ac91d2294de98c06ed5f to 23c86c5892d2c1e0784799008a0c4fc304f47e34 [+] Thu Jul 22 20:05:17 2021 +0800 | dean.ty.chiang@mai.. | 23c86c5 | tag v531r07 [+] Thu Jul 22 19:58:24 2021 +0800 | dean.ty.chiang@mai.. | a0c5b5e | tag v531r06 vendor/skb/prebuilts/boot_config changed from 1955df4e8450063f27250d81366c06e20127fa6f to 3cd2bd7e4e7543d7302b7028048aee0a5fc041c4 [+] Thu Jul 22 18:20:25 2021 +0900 | april4th@sptek.co.kr | 3cd2bd7 | v19.531.7 [+] Thu Jul 22 18:14:47 2021 +0900 | april4th@sptek.co.kr | e804c7c | v19.531.6 vendor/skb/prebuilts/digicap_btv-app changed from 503b05c05444ff0b19a868ddd4df465a13a94c0f to 64b80f062afe2eab939cc9aa58e673ac82ed00a5 [+] Thu Jul 22 18:05:59 2021 +0900 | kimyh@digicaps.com | 64b80f0 | SKB_STB_Home_UI5.0_AI2MAX_v1.15.0_r18719_foxconn_20210722 배포 vendor/skb/prebuilts/digicap_senior changed from d6afce58e6206b64f4faac19eecb43f26986ba5a to 90312f8b9fab5c74d40e588da3f896ce12c6f13e [+] Thu Jul 22 16:57:43 2021 +0900 | ejlee@digicaps.com | 90312f8 | SKB_Senior_AI2MAX_v1.531.0_r2042_foxconn_20210722 vendor/skb/prebuilts/digicap_zemkids changed from 18969076718ab4eaf6dd019a31c90275945aa74d to 337ace3561b679994745a4b1633c11330f6b81be [+] Thu Jul 22 17:40:00 2021 +0900 | ejlee@digicaps.com | 337ace3 | SKB_ZemKids_AI2MAX_v1.531.0_r3409_foxconn_20210722 vendor/skb/prebuilts/skb_navigator changed from e5ff44bc2dc1280a0fe6e839d7460d4edfa92c72 to 1471d199129329c30811599ca6d6d3fa28a5742b [+] Thu Jul 22 19:57:08 2021 +0900 | april4th@sptek.co.kr | 1471d19 | v2.0.12 * [BTF-399] Add newline at the end of channel.xml for readability vendor/skb/prebuilts/skb_qsm changed from 9ba06312758411b3591725ff928360e0b2e239a1 to 4e1db99d1bb4e082dc048e059875fad300a8ba15 [+] Thu Jul 22 13:37:49 2021 +0900 | sptek-stb5@sptek.c.. | 4e1db99 | qsm_assistance_app add TARGET_PRODUCT(SMART3-BID-AT200, BFX-AT100, BIP-UW200) vendor/sptek changed from df18c042c86bfcbedda59f5eeae37a4fb104c158 to 373243aedc5751b65f5a2fe4c5cf59c5a471e3bb [+] Thu Jul 22 13:18:32 2021 +0900 | april4th@sptek.co.kr | 373243a | updated tsdump : adding usages [+] Thu Jul 22 12:00:24 2021 +0900 | april4th@sptek.co.kr | 0be5b39 | fixed sepolicy of tsdump [+] Thu Jul 22 11:59:42 2021 +0900 | april4th@sptek.co.kr | 52ab921 | updated tsdump [+] Thu Jul 22 11:57:58 2021 +0900 | april4th@sptek.co.kr | bf56bdd | Merge branch 'bg5ct-android-10' into bg5ct-android-10_tsdump [+] Tue Jul 13 13:55:34 2021 +0900 | april4th@sptek.co.kr | 59a91cd | temporarily commit for tsdump |
|
|
Hi, Jason, Could you please send me the log and result of each test case? As you know, the log and result are generated on android-gts/logs and android-gts/results. And, if possible, please send me the log and result of each test case after downgrade the firmware to "20210722 Daily build". It's helpful to compare with passed result. Thank you. |
|
|
Reminder sent to: (ALTech) Sangmin Choi |
|
|
Hi Wooshin, Please check the attachments, It's FAIL logs/result. the log/result are included in the zip file. |
|
|
Hi Wooshin, The attachments in this note are PASS result/log Thanks |
|
|
Hi Wooshin, 19.531.12 is still Fail Please let us know when this issue can be resolved? |
|
|
Hi, Jason, I asked to HomeUI APK vendor, I will let you know when I get any response or schedule to fix. Thank you. |
|
|
Hi, Jason, Could you please run the GTS failed items using attached Home UI APK? You can change the Home UI APK using following commands. $ adb root $ adb remount $ adb push app-ai2max-debug_20210818_1820.apk /system/app/SKB_SBOX_STB_Home_UI5.0/SKB_SBOX_STB_Home_UI5.0.apk $ adb shell sync $ adb reboot You can check the Home UI APK was updated correctly using following commands. The versionCode should be 1066. $ adb shell dumpsys package com.skb.tv | grep version versionCode=1066 minSdk=28 targetSdk=29 versionName=1.15.0 signatures=PackageSignatures{c2b7a2b version:2, signatures:[f3e770b2], past signatures:[]} Thank you. |
|
|
Hi Sangmin, I used the version 19.531.12 and the new HOME UI apk (versionCode=1066) to verify these failures, these 2 GTS items are Pass. But this test apk enabled the debuggable flag, Don't upload this apk to Bitbucket. |
|
|
Hi, Jason, Thank you for checking. The released version of Home UI APK will be released tomorrow. After release the APK, please run the GTS fail items one more. I will let you know when the APK is released. Thank you. |
|
|
Hi, Jason, Could you please run the GTS fail items using this Home UI APK? This is not a released version but the Home UI vendor fixed something again. I am checking the CTS fail items so you don't need to run the CTS fail items. Thank you. |
|
|
Hi Sangmin, The result of these 2 items are pass (20210819_1000.apk) |
|
|
Hi, Jason, Could you please run the GTS fail items using 20210820 daily build? This build included the official version of Home UI APK. http://altserver01.iptime.org/release_by_fxn/swan_nightly/SD_IMG/BFX-UA300_20210820_SD_v531r15_D218 Thank you. |
|
|
Hi Sangmin, Our QA has verified these items with official build 19.531.14 The results of these 2 items are pass |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2021-08-06 16:22 |
|
New Issue | |
| 2021-08-06 16:22 |
|
Status | new => assigned |
| 2021-08-06 16:22 |
|
Assigned To | => (ALTech) Wooshin Kang |
| 2021-08-06 16:22 |
|
File Added: GtsPlayStoreHostTestCases.jpg | |
| 2021-08-06 16:22 |
|
File Added: 0722_0723.diff | |
| 2021-08-06 16:23 |
|
Issue Monitored: (ALTech) SY Yoon | |
| 2021-08-06 16:23 |
|
Issue Monitored: (SW) Jacky Chiang | |
| 2021-08-09 16:39 |
|
Relationship added | related to 0001313 |
| 2021-08-12 08:59 | (ALTech) Sangmin Choi | Note Added: 0007847 | |
| 2021-08-12 09:01 | (ALTech) Sangmin Choi | Issue Monitored: (ALTech) Sangmin Choi | |
| 2021-08-12 09:01 | (ALTech) Sangmin Choi | Note Added: 0007848 | |
| 2021-08-12 15:57 |
|
File Added: testNonInstantApp_fail.zip | |
| 2021-08-12 15:57 |
|
File Added: testInstantApp_fail.zip | |
| 2021-08-12 15:57 |
|
Note Added: 0007852 | |
| 2021-08-12 16:28 |
|
File Added: testNonInstantApp_pass.zip | |
| 2021-08-12 16:28 |
|
File Added: testInstantApp_pass.zip | |
| 2021-08-12 16:28 |
|
Note Added: 0007853 | |
| 2021-08-16 09:54 |
|
Note Added: 0007871 | |
| 2021-08-17 09:41 | (ALTech) Sangmin Choi | Note Added: 0007875 | |
| 2021-08-18 15:13 | (ALTech) Wooshin Kang | Assigned To | (ALTech) Wooshin Kang => (ALTech) Sangmin Choi |
| 2021-08-18 17:59 | (ALTech) Sangmin Choi | File Added: app-ai2max-debug_20210818_1820.apk | |
| 2021-08-18 17:59 | (ALTech) Sangmin Choi | Note Added: 0007918 | |
| 2021-08-18 18:59 |
|
Note Added: 0007921 | |
| 2021-08-18 19:08 | (ALTech) Sangmin Choi | Note Added: 0007922 | |
| 2021-08-19 09:18 | (ALTech) Sangmin Choi | File Added: app-ai2max-debug_20210819_1000.apk | |
| 2021-08-19 09:18 | (ALTech) Sangmin Choi | Note Added: 0007924 | |
| 2021-08-19 10:28 |
|
Note Added: 0007925 | |
| 2021-08-20 10:18 | (ALTech) Sangmin Choi | Note Added: 0007930 | |
| 2021-08-20 10:18 | (ALTech) Sangmin Choi | Status | assigned => resolved |
| 2021-08-20 10:18 | (ALTech) Sangmin Choi | Resolution | open => fixed |
| 2021-08-20 11:48 |
|
Status | resolved => closed |
| 2021-08-20 11:48 |
|
Note Added: 0007932 |
